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Abstract 



This study reports an attempt to improve 
the administration of th° Peabody Picture Vocabulary Test 
(PPVT) by identifying and modifying aspects of the test 
which adversely affect disadvantaged preschoolers' 
performance. The resultant test was called the Modified 
Peabody Picture Vocabulary Test (M-PPVT) . Two samples from 
the same lower class population were compared on the 
standard and modified test versions. The M-PPVT required 
the examiner to provide encouragement and approval, to 
follow a schedule of high reinforcement, and to give 
specific instructions before each stimulus word. A modified 
record sheet facilitated administration and recording of 
responses. In Study I both test forms were administered 
twice to 36 Negro children. There was slightly increased 
score stability under the M-PPVT, but practice effects were 
not significant. Eoys scored significantly higher than 
girls. In Study II, 19 black children took the PPVT and 19 
took the M-PPVT. Results suggested that the M-PPVT offered 
a slight advantage to lcw-sccring subjects possibly due to 
examiner controls. Selection and evaluation of test 
instruments for disadvantaged preschoolers should consider 
psychometric properties, and the influences of examiner 
styles and test administration controls on performance. (DR) 
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One of the major difficulties encountered by researchers interested 
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in clinical and educational testing has been the selection of appropriate 
tools to be used as screening measures for children who have limited 
expressive vocabularies or who are verbally inhibited in testing or class- 
room situations. The Peabody Picture Vocabulary Test (PPVT) has been 
widely used to identify level of receptive language functioning and to 
assist in placing children in various remedial programs. A complete 
description of the test and its reliability and validity data are given 
in the manual (Dunn, 1965). Data has been collected on a variety of 
populations including normal children, trainable mental retardates 
(Dunn and Hottell, 1961), cerebral palsied (Dunn and Harley, 1959), and 
schizophrenic children (Shaw, 1961). There is only one study, to our 
knowledge, whose subjects were preschool, black children living in urban 
poverty (Milgram and Ozer, 1967). These subjects consistently obtained 
lower scores on the PPVT than on the Stanford-Binet (S-B), and the indi- 
vidual scores were somewhat unstable over time; hence these authors 
concluded that the PPVT may be more susceptible to environmental im- 
poverishment than the S-B. 

The present authors observed that examiners vary in their style 
of administering the PPVT. Dunn (1965) states in his manual that 
administration of the test requires no special training. However, different 
examiners tend to obtain different scores from the same subjects, presumably 
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due to their differences in reinforcement styles, reinforcement schedules, 
different patterns of expectancy, etc. Further support for these obser- 
vations comes from a previous unpublished study of the authors where the 
performance of the middle and lower class Negro preschoolers was compared 
on PPVT test. The mean difference in Raw Score was 25.5 points in favor 
of the middle class sample and 32.3 in J.Q. points in the same direction. 

The mean I. Q. on the PPVT was 67.2 and on the S-B was 92.7 for the same 
lower class sample. 

Recent research on examiner and situational variables has demon- 
strated that many incidental variables, not directly related to those 
under investigation may influence a subject's response. Rosenthal (1966) 
has comprehensively reviewed a number of research studies pertaining to 
such variables. When an examiner interacts with a subject, both his 
physical and psychological attributes may prove significant determinants 
of the subject's responsiveness. Masling (1966) also reviewed a number 
of studies demonstrating the impact of administrative procedures, testing 
situations and examiner differences. Additional evidence comes from a 
study with disadvantaged preschoolers reported by Zigler and Butterfield 
(1968) which demonstrates the impact of reinforcement styles and the 
expectancy of success or failure on test performance. Studies of modeling, 
identification and imitation (Bandura and Huston, 1961; Ware, Kowal, and 
Baker, 1963; and Bandura and Walters, 1964) also demonstrate the importance 
of such variables. 

The findings of the above-mentioned studies and our own experience 
in testing disadvantaged preschool children led us to modify some, and 
radically alter other areas of the standard administration of the test, 
which we shall refer to as "Modified Peabody Picture Vocabulary Test" 
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(M-PPVT) • The only other known modification of the PPVT was conducted 
by Melcer and Peck (1966) with cerebral palsied children. Their modified 
test consisted of 20 plates (four pictures each), which gave subjects the 
choice of two correct responses, one an ’'Object,’ 1 the other an ’’Action.” 
The purpose of the present study was twofold. First, to explore 
the possibility of improving the administration of the PPVT by identify- 
ing and then modifying those aspects of the test which seem to have an 
adverse effect on the disadvantaged preschool children's performance. 
Second, to compare the performance of two samples from the same lower- 
class population on the Standard and Modified administration of the PPVT. 

Methodology 



A. Modification : 

The major areas of modification are concerned with (1) expectancy, 
(test length and "ceiling”), (2) reinforcement (style and schedule), and 
(3) specificity of the stimulus. A modified record sheet facilitates 
administration and the recording of responses. 

Expectancy: It has been the experience of the authors that disadvantaged 

preschool Negro children get discouraged once they are unsure about three 
or four consecutive items. The examiner often picks up the child's 
discouragement, assumes he will not perform well and, "expects” him to 
reach a ceiling quickly. Thus, high need for encouragement and approval 
on the part of the child together with low expectancy on the part of the 
examiner potentially depress PPVT scores. MacKinnon (1962) has succinctly 
stated, "If our expectancy is that a child of a grlven intelligence will 
not respond creatively to a task which confronts him, and if we make this 
expectation known to the child, the probability that he will respond 
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creatively is very much reduced.” The items in the PPVT are arranged in 
order of increasing difficulty which, to a certain extent, contributes to 
the child's discouragement and the examiner's low expectancy. For this 
reason we took the first 70 picture plates from the test booklet and 
randomized them, administering all items to all subjects. These were 
preceded by nine sample items. (The 70 items include the highest ceil- 
ing item reached by any subject in our population, plus ten). This 
modification eliminates the examiner-determined ceiling. 

Reinforcement : Our observations of test administrations highlighted the 

children 's considerable sensitivity to social (verbal) and interpersonal 
(non-verbal) reinforcers. The examiner's effectiveness as a reinforcing 
agent has been investigated in a number of studies (Sacks, 1952; Zigler, 

1963; McCoy and Zigler, 1965; Weiner, 1965; and Costello, 1967). Several 
of these studies indicate greater variation in performance among lower 
class than middle class children as a function of reinforcement conditions. 
Additional studies concerned with quantity of social reinforcement suggest 
that 50 percent reinforcement yielded a performance level approaching that ob- 
tained under 100 percent reinforcement (Jenkins, 1950; Lewis, 1960). Crandall 
(1963) proposed a situational hypothesis relative to change in reinforcement 
strategy which predicts that non-reactions (e.g. silence) acquire a rein- 
forcement value opposite to the value of the preceding verbal reinforcer, 
i.e. silence after positive reinforcement is responded to as negative 
and silence after negative reinforcement becomes positively reinforcing. 

These studies in conjunction with our observations of examiner 
variations in reinforcement styles determined our choice of a reinforcement 
strategy for the M-PPVT. We had found that enthusiastic, highly reinforcing 



examiners had a positive (though not statistically significant) influence 
on test scores of preschool children. Thus we chose a reinforcement 
strategy which approached that of the naturally "high" reinforcers. Six 
reinforcing statements were randomly assigned to test stimuli and printed 
on the record sheet.** Test responses were reinforced according to the 
following schedule, 100 percent of the responses were reinforced for the 
first 20 items (regardless of their accuracy), 50 percent for the next 

20 items, and 33.3 percent for the last 30 items. All nine examples were 
reinforced . 
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Specific ity of the stimulus : Instructions preceding each stimulus word 
were randomly assigned stnd printed on the M-PPVT record to control for 
examiner variation, e.g. item 14 became "p oint to skirt;" item 31, 

"show me nest." 

M-PPVT Record Sheet ; The record sheet for the M-PPVT included for each 
item the original page number of the picture plate, the stimulus instruc- 
tion, stimulus word, and verbal reinforcement. Form A stimulus words 
were used. Instructions for using the modified procedure appear on each 
record sheet. An additional page of instructions regarding the establish- 
ment of optimal subject set, and other aspects of test mechanics supplement 
those provided in the PPVT manual. 

B. Comparison of PPVT and M-PPVT 
Study I 

In order to determine test-retest stability of each form, the PPVT 
and the M-PPVT were administered twice to "disadvantaged" Negro preschool 



** After Stevenson and Fahl (1961), these were the reinforcements chosen: 
"That's very good;" "Good;" "You're doing very well;" "That's fine;" "You 
know the pictures very well;" and "You're really good at this." 
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children attending two nursery schools. Thirty-six children from 
Research preschool, (18 boys and 18 girls, with a mean age 4.6 years) 
received PPVT and sixty-seven from a Head Start Center and the Research 
Preschool (32 boys and 35 girls, with a mean age 4.7 years) were given 
M-PPVT. Both groups were representative of four -year -olds living in a 
public housing project, on Chicago’s West side. Raw Score data was 
used to determine the test-retest reliability, median scores and 
practice effects. This reliability study is reported in greater 
detail in a separate paper (Costello and Ali, 1969). In the present 
paper we are reporting briefly the reliability, effects of practice, 
and sex differences which emerged. 

Study II 

Thirty-eight preschool black children served as subjects for a 
study comparing PPVT and M-PPVT scores, (20 boys, with a mean age of 
4.3 years and 18 girls with a mean age of 4.2 years). Nineteen children 
were given the PPVT and 19 the M-PPVT. They were assigned to one or the 
other group on an alternating basis. Scores for four subjects on the 
PPVT were not used because of their unwillingness to finish the test, or 
their inability to follow the test instructions reducing the PPVT sample 
size to 15. 

Results 

In both studies (I and II) the analyses are based on raw score data, 
since small differences in raw scores yield large differences in M.A. and. I.Q.'s» 
Study I 

Test-retest reliability for the M-PPVT was 0.86 as compared to 0.77 
for the PPVT suggesting slightly increased score stability under the modified 
administration (see Costello and Ali, 1969 for further elaboration). Of 




7 



interest was the gain (practice effect) between the two test administrations, 
separated by two weeks. In both forms (PPVT and M-PPVT) there is a non- 
significant increase in mean raw score over the two weeks suggesting a 
slight but unimportant practice effect. (The approximately three points 
increase represents a change of approximately two months in M.A. for PPVT — 
and three months in M.A. for M-PPVT). 

Insert Table 1 about here 

Sex differences emerged in both administrations of the PPVT and M-PPVT 
with boys scoring significantly higher than girls. Mean differences are 
from 2 to 7 points, corresponding in M.A. to 2 to 10 months. 

Congruent with other findings relative to partial reinforcement, 
we found that rate of errors increased when reinforcement changed from 
100 percent to 50 percent, stabilizing to the initial rate during the 
33 percent reinforcement period. We have since realized that a dis- — 

i 

proportionate numbei: of difficult items occur in the 50 percent rein- 
forcement segment of the test, which may alternately account for the 
increased rate of errors. 

Study II 

Comparison of raw scores obtained on the PPVT and M-PPVT yielded 
a non-significant difference in favor of the M-PPVT. 

Insert Table 2 about here 

Considering the small sample size and that the difference between means is 
significant at ,05< p <.10, it is possible that a significant difference 
would be found in a larger sample. The range of M-PPVT scores is somewhat 
narrower than that of PPVT scores, which may be a true difference or an 



Table 1 



Comparison of Mean Raw Scores for Test-Retest Administrations 

of PPVT and M-PPVT 1 



Test 


Sample 


N 


Time 1 
X 


Time 2 
X 


Student 1 s 
t_ 


PPVT 


Research 

preschool 


31 


26.2 


29.9 


1.58* 


M-PPVT 


ft 


36 


41.5 


43.4 


1.27* 


M-PPVT 


Head Start 


31 


37.2 


40.8 


1.93* 



* n.s. 

■^The PPVT data was collected some months before the M-PPVT data. As a 
result the means for PPVT and M-PPVT are not comparable. 



Table 2 



Comparison of Mean Raw Scores for PPVT and M-PPVT 



• 


Test 


N 


X 


Range 


Student's 

t 


PPVT 


15 


29.6 


15 - 51 




M-PPVT 


19 


34.5 


24 - 46 


1.78* 




PPVT 




Figure 1 - Frequency distribution of Raw Scores for the Standard (PPVT) 
and Modified (M-PPVT) administration. 
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artifact of the M-PPVT' s longer test length, which allows low scorers to 
gain extra points by guessing. Median score for PPVT was 35 and for 
M-PPVT was 36. The 25th percentile raw score however was 23 for PPVT and 
30 for M-PPVT. This suggests that the M-PPVT offers an advantage to low- 
scoring subjects, as shown in figure I. 

Discussion 

The M-PPVT offers some control over examiner variations in test 
administration of the PPVT. It was well accepted by the examiners, who 
were relieved of the need to establish a ceiling score and a reinforce- 
ment schedule. Time of administration was not remarkably increased. 
Examiners reported that instructions accompanying each stimulus word 
were helpful, but that reinforcing statements were often too long sug- 
gesting one or two word reinforcers would be more appropriate 0 

The test-ietest reliability study, (Study 1) indicated slightly 
greater stability for M-PPVT scores and provided data which indicated 
that practice with the test does not significantly increase test scores 
for either PPVT or M-PPVT. These findings counterbalance much of the 
criticism leveled at the PPVT as an unstable measure which is easily 
influenced by test experience. 

Data from the small comparison samples (Study II) suggest that the 
M-PPVT provides low-scoring children with some scoring advantage over the 
PPVT, although the differences were not statistically significant. We 
would like to suggest that examiner controls provided by the M-PPVT account 
for this advantage. It is possible, however, that the test length provides 
extra score points through guessing. 

Our experience with the PPVT and a modification of its standard 
administration (M-PPVT) suggest that further research is needed to clarify 



the influences of examiner styles and test-administration controls on the 
test-performance of young disadvantaged children. Limited observations of 
middle class Negro children have indicated less sensitivity to testing 
variations than we observed among lower-class (disadvantaged) groups. We 
conclude that in selection and evaluation of psychometric instruments 
especialty for 'disadvantaged' preschoolers attention must be directed 
not only to their formal psychometric properties, but also to the 
characteristics of the testing situation in which they are applied. The 
modification described in this paper presents one approach to futther 
standardizing some variables which surround test-administration. 



^This study was carried out at the Dr. Martin Luther King Family Center 
[referred to in this paper as the Research Preschool] , which is supported 
by the Kenneth F. Montgomery Charitable Foundation, in collaboration with 
the Illinois Department of Mental Health. Additional support was derived 
from a National Institutes of Mental Health General Support Grant, #1S0 1 - 
FR05 666-01. 

^The authors wish to thank the children who participated in the study, their 
parents, the staff at the Research Preschool and the Head Start Center for 
their cooperation and collaboration. The authors wish to express special 
thanks to Mrs. Lolita Castillo and Miss Millicent Handrich for carrying out 
the testing. 

^The authors wish to express special thanks to Mrs. Jacqueline Martin for 
conducting the tests and assisting in data analysis. 
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INSTITUTE FOR JUVENILE RESEARCH 
PRESCHOOL PROJECT 

Modified Procedure for Administering MPPVT 
Faizunisa Ali and Joan Costello 



Establishing an optimal subject set : 

1. The examiner should establish a rapport during the first 5 
minutes of the test. Some of the things which are helpful are: 

(a) Introduction of the examiner to the subject followed by a 
handshake, or some physical contact. 

(b) Looking at an animal picture book together. 

(c) Encouragement, acceptance and rewarding of the child by 
saying "You are a good listener, before we start our work, 
let's have some candies, I'm sure you're going to like them." 

2. The examiner should try to maintain a positive relationship with 
the subject throughout the test. 

3. The examiner should 'look' and 'smile' at the child most of the 
time and not keep looking at the test record or the picture plates 

4. No subject can, or should, be expected to do better or worse on 
the basis of sociability, verbal skills, or cheerfulness. 

5. A fixed schedule of reinforcement should be followed: 100% for 

the first 20 items, 50% for the next 20 items, and 33% for the 
last 30 items. These are indicated clearly on the test record. 

6. No positive or negative notations should be used on the test 
record to indicate a response. Record only the number of the 
response . 

Aspects of the test mechanics : 

1. All subjects should be tested individually in a quiet, unclut- 
tered room. 

2. Instructions are given on the test record. 

3. Stimulus words may be said loudly and clearly, more than 
once . if the subject doesn't hear them the first time. 

4. When the subject makes more than one choice, record the final 
response . 

5. If the subject continues to point to one location on plate after 
plate the examiner should point to picture No. 1 saying "look at 
this one," then to picture No. 2 saying, "and this one," then to 
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picture No. 3 saying, "and this one," and lastly to picture 
No. 4 saying, "and this one, too, O.K." 

6. After every ten responses the subject should be reminded "Be 
sure to look carefully at all four pictures." (A star (*) 
on the test record indicates when to remind.) 

7. The subject may take any reasonable amount of time per item 
to make his selection. However, an approximate time Of 30 
seconds is suggested. The subject may be encouraged by say- 
ing, "I know some are hard ones, look at all the four pictures and 
pick one." If no response is given this should be repeated again 
after 30 seconds. 



To readers: 

The Modified PPVT test record is included 
as an appendix to this report. It may not be du- 
plicated at this time pending decision by The 
American Guidance Services Inc. publishers of the 



PPVT. 



Summary 



A modification of the PPVT was undertaken in an effort to 
standardize administration practices and to control for some factors 
observed to adversely influence test performance among preschool dis- 
advantaged children. 

Areas of modification were: expectancy of ceiling (all children 

received 70 randomized items), reinforcement (specific verbal reinforce- 
ments were given for each item), stimulus specificity (instructions 
preceding each stimulus word were specified). Results suggest the 
modifications positively influence test scores and contribute to improved 
test-retest stability. 



